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FIELD OF THE INVENTION 

[0001 ] The present invention relates to a method and apparatus for selecting or adjusting 

services or settings of an electronic device on a display of the electronic device. 

BACKGROUND OF THE INVENTION 
5 [0002] The conventional means of selection of services on or adjustment of settings of 

electronic devices, including, for example, a TV, set-top box, DVD player, VCR, domestic 
appliance, and other similar devices, typically has the disadvantage of covering the entire area of 
the device's display and also typically requires a significant number of key depressions until the 
desired selection is shown and is selected. This selection process is a significant problem for 

10 many users of such electronic devices, including disabled persons and those who are unfamiliar 
with setting electronic devices, are fearful of adjusting such devices, have no patience to deal 
with the user interface which is often complex, or who do not want to spend the time and effort 
reading the device's operational manual. Such device operational manuals, if actually supplied 
with the device (which is not always the case), are typically somewhat incomprehensible due 

15 either to their technical complexity, the complexity of the technical language used, their over- 
simplicity, their bad writing style, or their unavailability in the user's native language. 
[0003] Additionally, remote control devices, such as those used with televisions, DVD 

players, VCRs, etc., have a large number of keys, and the design of the key pads for each device 
is typically different for different manufacturers of like devices and even different for different 

2 0 devices of like manufacturers. 

[0004] There is thus a need for an electronic device user interface that is simple for a user 

to operate without the need to study an incomprehensible written user's manual. 
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[0005] One such user interface that solves the aforementioned problems is disclosed in 

PCT Patent Publication No. WO 00/65429. In accordance with that user interface, a display on 
or associated with the electronic device presents to the user a pair of intersecting cross-point 
navigation bars. At least one of these bars is scrollable, and each bar displays one or more object 
5 fields. By selectively scrolling one or both of the bars, one at a time, by pressing appropriate 
buttons on the electronic device or its remote controller, the user positions a particular object 
field, or selection, at the point where the two bars intersect. When the user depresses a "select" 
button, the displayed object field is selected, and either a bar of the display transforms to the 
selected sub-field, or the electronic device performs the action corresponding to the displayed 

10 object field selected, thereby adjusting or setting the electronic device in the desired manner. By 
pressing another button when a particular object field is at the intersection of the two bars, the 
level of the object field displayed in the entire corresponding bar is changed so that the user is 
given a group of choices that fall under the selected object field category. Thus, for example, if 
the vertical bar has six object fields (A, B, C, D, E, and F), the horizontal bar will show sub- 

15 fields corresponding to the object field positioned at the intersection of the two bars (F-l, F0, Fl, 
F2, F3, etc.), as shown in Fig. 2a of the patent publication. If the user depresses a predefined 
navigation key, sub-sub-fields (F2:4, F2:0, F2:l, F2:2, F2:3, etc.) corresponding to the sub- 
field (F2) positioned at the intersection of the two bars are then displayed on the vertical bar, as 
shown in Fig. 2b of the patent publication. In actual use, words descriptive of, for example, 

2 0 instruction categories or actual instructions to be transmitted to the electronic device are 
displayed to the user, not merely letters and numbers. Such listing and selection of sub- and sub- 
sub-fields can go down to as many levels as is necessary to provide the user with a desired 
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selection of options. To navigate upward through the levels, a second predefined navigation key 
is depressed by the user, and, as a result, the visual content of the appropriate bar is changed to 
reflect a change in field level. 

[0006] Although the user interface disclosed in PCT Patent Publication No. 

5 WO 00/65429 is fully able to permit a user to satisfactorily navigate among a plurality of possible 
instructions or device settings arranged in a plurality of groups, sub-groups, sub-sub-groups, 
etc., it may be somewhat difficult for a user to determine where in the menu hierarchy of 
possible instructions and groups of instructions he currently is so that he can easily navigate to 
another desired available electronic device instruction or setting, or group of such instructions or 

10 settings. This difficulty arises because only two levels of groups (or fields) are simultaneously 
displayed to the user. Whenever a group, sub-group, etc. is selected, the appropriate bar is 
overwritten by the sub-entries in the selected group or sub-group. Thus, no map is displayed 
showing generally where in the hierarchy of groups, sub-groups, etc. the user currently is 
located. As a result, a user unfamiliar with the hierarchy of the groups may be forced to 

15 randomly press the navigation buttons repeatedly, thereby navigating up, down and/or through 
the levels, until he has found the desired instruction or group of instructions, or a group of 
instructions or an instruction that is familiar to the user to enable him to navigate to the 
instruction or group of instructions actually desired. 
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SUMMARY OF THE INVENTION 

[0007] The present invention provides a method and apparatus for controlling, adjusting 

and/or setting of electronic devices and appliances controlled by remote control devices, such as 
wireless and pointing devices, or also voice-controlled devices. The invention allows the user to 
5 navigate through a hierarchy of groups of commands or selections while continuously providing 
the user with information as to where the user is currently located in the hierarchical structure of 
groups so that navigation through the groups and individual selections is simplified. 
[0008] Suitable electronic devices and appliances to be controlled include, for example, 

television sets, satellite receivers, set-top boxes, cable television controllers, computers, 

10 household equipment, telephones, mobile phones, personal digital assistants, DVD players, CD 
players, VCRs, stereo equipment, etc., especially appliances provided with user interfaces such 
as display screens for interaction with remote control and other key pad devices. 
[0009] In accordance with the present invention, a scrollable cross-point navigation 

image is displayed on a user interface display to select a feature by combining two object fields. 

15 Two bars are displayed, each bar containing a plurality of panels, with each panel displaying a 
separate folder or particular setting. The two bars are positioned so that the bars overlap in a 
single focus panel. Preferably, the two bars are sized, shaped and positioned so as not to 
completely obscure the entirety of the display. As a result, a user can view the two bars, and can 
also view any programming or other information that is also being presented on the display. 

2 0 [0010] The instructions, settings and/or selections that are available for selection by the 

user to adjust or set the electronic device are arranged in an associated database in one or more 
levels of groups (sub-groups, sub-sub-groups, etc.) so that settings, etc. of a similar nature are in 
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the same group, with the top most level being the most general, and the lowest most level being 
particular instructions. In between the top and bottom levels, there may be sub-levels which 
organize the contents of the database. The items in each level are linked to one or more items in 
immediately higher or lower levels, if any, to form a tree- like hierarchical structure. 
5 [0011] When a user initially activates the user interface feature of the electronic device 

by entering the appropriate command on an input device, the user interface appears on a display 
on or associated with the electronic device being controlled. The focus panel displays (1) the 
user's current lowest level in the hierarchical structure of groups of settings or selections and (2) 
the next higher level, if any. The next higher level, if any, is shown in an adjoining panel on the 

10 horizontal bar, the next higher level, if any, is shown in a next adjoining panel on the horizontal 
bar, and so on until there are no further higher levels to display, at which point the remaining 
upper-most level folders are displayed in the panels on the horizontal bar. In the panels of the 
vertical bar are sub-folders, if any, or individual settings, if any, that are within the folder 
appearing in the focus panel, that is, such sub-folders or settings that are of the same level as the 

15 user's current lowest level in the hierarchical structure appearing in the focus panel. As the user 
descends down the folder hierarchy, the panels in the horizontal bar shift to the right and panels 
identifying levels between the current level and the top most level are displayed. As the user 
ascends through the folder hierarchy, the panels in the horizontal bar shift to the left. To 
navigate up or down folder levels and to select a particular folder at any level, the user employs 

2 0 the input device to cause the bars, one at a time, to scroll up, down, left and right to cause a 
particular panel to be shifted into the focus panel and thereby navigate through the various levels 
of the hierarchical structure of groups of settings or selections. When the focus panel is 
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positioned at a desired folder, the user selects it with the input device. If a particular ultimate 
setting or instruction within a folder, sub-folder, etc., is selected by the user, the electronic device 
is instructed to perform the function of that setting or instruction. To move upward in the 
hierarchy to one of the folders shown in the horizontal bar to the right of the focus panel, the user 
5 simply uses the input device to scroll the horizontal bar as desired. 

[0012] The user interface, thus, always displays the user's current location in the 

hierarchical structure and the path of the folder, sub-folder, and sub-sub-folder, etc., that the user 
descended through to get to the current location. Because this folder path information is 
continuously displayed to the user, navigation through the folder structure and the instructions or 
10 settings within that structure is immediately apparent and simple without the need for a user's 
manual explaining the structure of the folder structure. 

[0013] Other objects and features of the present invention will become apparent from the 

following detailed description considered in conjunction with the accompanying drawings. It is 
to be understood, however, that the drawings are intended solely for purposes of illustration and 
15 not as a definition of the limits of the invention, for which reference should be made to the 
appended claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0014| In the drawings, wherein like reference numerals delineate similar elements 

throughout the several views: 

FIG. 1 is a schematic block diagram illustrating one embodiment of means used 
5 to accomplish a apparatus in accordance with the present invention; 

FIG. 2 is a schematically diagram of a preferred embodiment of a user interface in 
accordance with the present invention; and 

FIGS. 3, 4, 5, 6 ? 7, 8, and 9 show one embodiment of the present invention at 
various different stages of operation. 
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DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS 

[0015] Figure 1 is a schematic block diagram of one embodiment of an apparatus 10 m 

accordance with the present invention, comprising a UI objects database 12, a graphics library 
14, a graphics generator 16, an externally supplied data means 18, a content database 20, an 
5 interaction interpreter 22, an input device 24, and a user interface 26. 

[0016] The input device 24 is any means that can be employed by a user to enter 

commands to control the user interface 26 and can be any of a number of manual controllers, 
such as, for example, a hand-held remote control with a keypad for a television set-top box, a 
keyboard for a PC, a remote controlled computer mouse, or a control panel with a keypad for a 

10 microwave oven. When a user wants to change a setting of the interface 26, the input device 24 
is manipulated, such as by the depressing of keypad buttons, to transmit a signal to the 
interaction interpreter 22. Preferably, as will become more apparent from the discussion below, 
the input device has directional keys (up, down, right, and left) and a "select" key which a user 
can depress to provide a selection command. The input device 24 may instead and/or also 

15 comprise means for detecting and interpreting spoken commands of the user. A spoken 
command device would for example, include a microphone, a data processor, a database 
containing vocabulary data, and speech recognition software to recognize voice commands of a 
user to the electronic device 

[0017] An interaction interpreter 22 interprets signals received from the input device 24 

2 0 and sends the corresponding instruction to a graphics generator 16. The interaction interpreter 22 
transforms commands from the input device 24 to actions provided by the graphics generator 16. 
[0018] The content database 20 contains information, and groups or folders of 
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information which can be presented on the user interface 26, which is preferably a screen, such as 
a television screen, monitor or flat panel display, such as liquid crystal or a plasma display. 
Samples of such information could be, for example, names of object fields containing sub-object 
fields or finite objects and help-texts that are presented to a user upon entry by the use of the 
5 appropriate commands. An object field is the name of a class or group of settings, sub-fields of 
settings, or sub-sub-fields of settings, etc. An example of an object field is the category or 
group, "Films". A finite object is a direct setting of a feature for the electronic device. An 
example of a finite object is the particular film, "Die Hard". All material in the content database 
20 can be altered and/or edited by a content provider, such as the original equipment 
10 manufacturer of the electronic device, or the service provider of material presented to the user 
and controlled through the user interface 26. Such a service provider would include a cable 
television company that transmits television programming, movies and other entertainment to a 
user. In addition, if desired, some or all of the material in the content database may be altered 
and/or edited by the user. For example, a user may want to delete certain television stations that 
15 are not of interest, the user may want to rename folders, or the user may want to add additional 
objects, folders, subfolders, etc. Such added material might include bookmarks or shortcuts to 
web pages or locally stored content (such as folders, documents, video files, music files, etc. on a 
memory hard drive), control settings to a connected device at the user's location (such as a CD, 
DVD or video tape player/recorder), etc. 
2 0 [0019] Externally supplied data 18 represents any content that is in the content database 

20 from any source. 

[0020] The UI objects database 12 contains types of graphical objects that can be 



9 



presented on the user interface 26. The UI objects database 12 supplies a graphics library 14 
with generic representations of the types of graphical objects. The graphics library 14 contains 
functions to manipulate the UI objects in the interface 26. The graphics library 14 supplies the 
graphics generator 16 with specific instances from the UI objects database 12. 
[0021 ] The graphic generator 16 controls the graphical presentation of the user interface 

26 as well as manipulation accomplished by a user. The graphics generator 16 performs actions 
signaled by the interaction interpreter 22 through collecting content from the content database 20 
and by merging the content with the graphics library 14 and delivering presentation of a desired 
action to the user interface 26. The user interface 26 presents feedback of any action performed 
by a user of the interface 26. 

[0022] Figure 2 schematically illustrates a user interface 26 in accordance with one 

embodiment of the present invention. The user interface 26 has two intersecting bars, preferably, 
a vertical bar 32 and a horizontal bar 34. The bars 32, 34 are preferably perpendicular to one 
another and are positioned proximate edges of the display area of the user interface 26 so that 
obstruction by the bars is minimized of any background picture 36, such as a television program, 
graphics, etc. Although the bars 32, 34 are shown as being positioned proximate the left and 
bottom edges of the user interface, alternatively, they may be at any other location, such as free 
floating at any location in the background picture 36, or may be positioned along adjacent edges 
of the user interface. In addition, although bars 32, 34 are shown as being linear in shape, they 
may assume any shape, such as, for example, curved into two circular or oval lines. Each of the 
bars 32, 34 is comprised of a plurality of panels, with vertical bar comprising panels 54, 30, 42, 
44, 46, 48 and 52, and with horizontal bar comprising panels 51, 30, 41, 43, 45, 47 and 49. Each 
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bar 32, 34 may comprise more or fewer panels, as desired. The two bars, 32, 34 intersect with a 
common panel, focus panel 30. Although the panels are show as being substantially rectangular 
in shape, they may assume any shape, such as square, oval, round, hexagonal, etc. Each of the 
panels preferably has one or more areas on which appears textual information and/or graphics. 
5 For example, each panel of the vertical bar 32 has a smaller upper area 62 and a larger centra] 
area 60. Similarly, each panel of the horizontal bar 34 has a smaller lower area 62 and a larger 
central area 60. The focus panel 30, which is the panel where the vertical bar 32 and the 
horizontal bar 34 intersect, preferably has a larger central area 60a, a smaller lower area 62a, and 
a smaller upper area 62b. The areas 60, 60a, 62, 62a, and 62b of the panels are used to display 

10 the textual information and/or graphics, as discussed below. The user interface 26 preferably 
also has an information field 38 positioned below the horizontal bar 34 where additional 
information can optionally be displayed. Finally, the user interface 26 preferably displays a 
plurality of possible navigation commands, shown as up, down, left and right arrows 55, 56, 57, 
58 and a "Select" command 59. Although the navigation commands are shown as directed 

15 arrows 55, 56, 57, 58, they may also be depicted as words or other pictures, such as pointing 
fists. The navigation and "Select" commands may be continuously displayed and highlighted 
when the user selects a particular command with the input device 24, or, alternatively, only 
displayed when a user actually selects that command. Although the command graphics 55, 56, 
57, 58, 59 are show in the upper right of the user interface 26, they may be in any position. 

2 0 Preferably, the command graphics 55, 56, 57, 58, 59 are omitted entirely from the display at all 
times. However, if the user interface is a mouse, the display command graphics, such as those 
shown, enable selection by the user of a command by clicking with the mouse's pointer on the 
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appropriate command graphic 55, 56, 57, 58, 59. Additional, if the display is a touch screen, 
command graphics may be displayed so that touching by the user of the appropriate graphic 
selects that command for execution. 

[0023] The various portions of the bars 32, 34, any text or graphics on the bars 32, 34, 

5 and the commands 55, 56, 57, 58, 59, and are preferably suitably colored or shaded to contrast 
appropriately against the background picture 36 and other elements of the displayed information 
on the user interface 26 so that the user can easily discern all of the displayed information. 
[0024] In operation, a user initially activates the user interface feature of the electronic 

device by entering the appropriate command on the input device 24. Thereupon, the user 

10 interface 26 appears on the appropriate display on or associated with the electronic device. For 
certain electronic devices where information of interest is continuously shown, such as 
entertainment programming on a television monitor, for example, it is desirable that the user 
interface 26 only appear when the user wants to change a setting of the television. For other 
electronic devices where the associated display does not provide any other information, such as, 

1 5 for example, a microwave oven, the user interface 26 might be continuously displayed. 

[0025] All possible instructions, settings and/or selections available to the user to adjust 

or set the electronic device are arranged in the content database 20 in one or more levels of 
groups (sub-groups, sub-sub-groups, etc.) so that settings, etc. of a similar nature are in the same 
group. The items of a first level are very general. In a second level, the items are more detailed 

2 0 than in the first level, but are still somewhat general. In a third level, the items are even more 
detailed than in the second level. And so on. The items are linked according to their contents. 
This means that an item of the first level is linked to one or more items of the second level. 
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Additionally, an item of the second level is linked to one or more items of the third level. And so 
on. Thus, with this linking structure, the items are arranged in a tree-like manner or hierarchical 
structure with any branch of the tree constituting a further level. Since, as discussed above, the 
user and/or the service provider may alter and/or edit the groups show at the various levels, a 
5 folder in one particular level, for example, may have more or fewer sub-groups, sub-sub-groups, 
etc. than other folders in that same level. Additionally, it is also possible that the user and/or 
service provider may want a particular ultimate selection or device command that is frequently 
used (and which one might expect to be relegated only to a sub-sub-group) to be positioned with 
folders at the highest level, for example. 

1 0 [0026] As discussed in detail below with reference to Figures 3 to 9 in which a particular 

embodiment is shown, the user's current location within the folder hierarchy is continuously 
displayed to the user in the horizontal bar 34. The focus panel 30 displays (1) the user's 
currently selected lowest level in the hierarchy in area 62a and (2) the next higher level, if any, in 
the area 62b. As the user descends into the folder hierarchy, the next higher level, if any, is 

15 shown in panel 41, the level above the level shown in panel 41 is shown in panel 43, and so on to 
the right across horizontal bar 34 until there are no further higher levels to display, at which point 
the remaining upper-most level folders are displayed in the panels on the horizontal bar 34. As 
the user descends down the folder hierarchy, the panels in the horizontal bar 34 shift to the right 
and panels identifying levels between the current level and the top most level are displayed. As 

2 0 the user ascends through the folder hierarchy, the panels in the horizontal bar 34 shift to the left. 
To navigate up or down folder levels and to select a particular folder at any level, the user 
employs the input device 24 to activate "up", "down", "left", "right" and "SELECT" commands 
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which cause the bars 32, 34 to scroll in the selected direction, as indicated in Figure 2) to cause a 
particular panel to be shifted into the focus panel 30. In the panels of the vertical bar 32 are sub- 
folders, if any, or individual settings, if any, that are within the folder appearing in area 62a of 
focus panel 30, that is, such sub-folders or settings that are of the same level as the user's current 
5 lowest level in the hierarchical structure appearing in area 62b of the focus panel 30. 

[0027] To more fully understand the present invention, one embodiment of the present 

invention is shown in operation in Figures 3 to 9, in which the numbering of the various elements 
has been simplified relative to Figure 2. In this particular embodiment, the electronic device is a 
television with a cable television set-top box and the user interface is used to select a particular 
1 0 entertainment program from among a plurality of possible entertainment programs. The present 
invention is not restricted to such an electronic device, and, as stated above can be used in 
conjunction with many other types of electronic devices. 

[0028] Referring initially to Figure 3, horizontal bar 34 is comprised of six panels 51, 30, 

41, 43, 45 and 47. In the lower areas 62 of the panels is text describing the name of the folder, 

15 group or field represented by the respective panels. The horizontal panels depict folders of 
categories of possible entertainment programming available to the user. Although all of the 
panels show the generic titles, "Folder A", "Folder", etc., except panel 41 which reads "Film", in 
actual operation the other panels would depict titles of other entertainment programming 
categories, such as, for example, "network television programming", "music video", "channel 

2 0 programming guide", "internet", etc. Rather than or in addition to text, graphics may be depicted 
on the panels, such as, for example, a movie projector for "Film", a television set for "network 
television programming", etc. The vertical bar 32 is comprised of seven panels 54, 30, 42, 44, 
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46, 48 and 52. These vertical panels depict sub-groups, bookmarks or selections, if any, 
collected in the folder identified in area 62a of focus panel 30. Although all of these panels 
except panel 30 are blank in Figure 3, in actual operation, each panel would display a title or 
graphic representative of its contents. The bars 32, 34 are positioned proximate edges of the 
5 display so that a great proportion of the current programming 36 is visible. Information field 38 
is blank in Figure 3, but in practice would display relevant information, such as the date and 
time, the status of the electrical device, error messages, a short help message, etc. which are 
associated with the folder or bookmark identified in area 62b of focus panel 30. 
[0029] As shown in Figure 3, the positioning of the bars 32, 34 is preferably selected so 

10 as to minimize obstruction of a background picture 36 that is being shown on the display. In 
Figures 4 to 9 the background picture 36 is omitted merely to simplify the Figures, although in 
practice the background picture, if any, would be displayed. 

[0030] In this example, the user wants to view a "Film", the panel for which is to the 

right of focus panel 30. Consequently, the user uses the input device 24 to enter the "right" 

15 command once, as shown by the highlighted right arrow 58. The horizontal bar 34 shifts one 
position so that the focus panel 30 now shows "Film" in area 62a, as shown in Figure 4. The 
vertical bar now shows in its panels the sub-groups, bookmarks or selections collected in the 
folder entitled "Film". One of panel 42 shows the category "Action" in its area 62, referring to 
action films. Other panels in vertical bar 32 display other exemplary categories of "Films", 

2 0 "Drama" (panel 30), "History" (panel 44), "Comedy" (panel 46), "Documentary" (panel 48), and 
"Musical" (panel 52). 

[0031] The user wants to view an Action film, the panel for which is up from the focus 
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panel 30. Consequently, the user employs the input device 24 to enter the "up" command once, 
as shown by the highlighted up arrow 55. The vertical bar shifts one position so that the focus 
panel 30 now shows the sub-group "Action" in area 62b and the name for the group "Film" in 
area 62a, as shown in Figure 5. To display the action films available, the user enters the "Select" 
5 command on the input device 24, as shown by the highlighted "SELECT" command 59. Upon 
selection, as shown in Figure 6, the name for the group selected, "Film", is then shifted to the 
right to panel 41, the name for the selected sub-group or bookmark, in this case "Action", is 
substituted into area 62a of focus panel 30, and all of the available action films are shown on the 
panels of vertical bar 32. Vertical bar 32 now shows all sub-bookmarks categorized under the 

1 0 bookmark "Action" and the folder "Film". 

[0032] One of the available action films is "Die Hard", the title of which appears in panel 

44 that is two panels up from focus panel 30. Although "Sub Bookmark" is shown for the other 
panels of the vertical bar, in practice the title of other available action films would be displayed 
in the panels. In a first step to select the film "Die Hard", the user enters the "up" command a 

15 first time, as shown by the highlighted up arrow 55. The vertical bar shifts one position so that 
the "Die Hard" panel shifts from panel 44 to panel 42, as shown in Figure 7. In a second step to 
select the film "Die Hard", the user enters the "up" command a second time, as shown by the 
highlighted up arrow 55. The vertical bar shifts one position so that the "Die Hard" panel shifts 
from panel 42 to focus panel 30, as shown in Figure 8, with "Die Hard" appearing in area 62b, 

2 0 Thus, in areas 62b of panels 42, 44, 48 and 52 appear sub-bookmarks (or selections) that are of 
the same level as the sub-bookmark "Die Hard" appearing in area 62b of focus panel 30. 
[0033] To see what options are available for the sub-bookmark "Die Hard", under the 
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bookmark "Action" in the folder "Film", the user activates the select command, as shown by the 
highlighted "SELECT" command 59. Upon selection of the sub-bookmark "Die Hard", as 
shown in Figure 9, the name for the group selected, "Film", is then shifted to the right to panel 
43, the name for the selected sub-group or bookmark "Action" is shifted to the right to panel 41, 
5 the name for the selected sub-bookmark "Die Hard" is placed into area 62a of focus panel 30, 
and the available sub-sub-bookmarks (each labeled as "Sub Bookmark2") for "Die Hard" are 
displayed in the vertical bar 32. Although in Figure 9 panels 42, 44, 46, 48 and 52 all merely 
show the title "Sub Bookmark2", in practice various selections would be shown such as, for 
example, "Movie", "Movie Trailer #1", "Movie Trailer #2", "Director's Commentary", "Filming 

1 0 Special Effects", or "Scene Selection" which, if selected, would list as sub-sub-sub bookmarks, 
various scenes in the film "Die Hard" that can be viewed. The user can then select the "Sub 
Bookmark2" of interest for viewing. If the sub-sub-bookmark "Sub Bookmark2" selected is 
itself a folder containing additional sub-sub-sub-bookmarks, the panels of horizontal bar 34 are 
shifted to the right by one position and the areas 62a and 62b of focus panel 30 are appropriately 

15 modified. 

[0034] As shown in Figure 9, even though the user has descended down a number of 

levels in the folder hierarchy, the current location is immediately apparent: panel 43 shows folder 
"Film", panel 41 shows bookmark "Action", area 62a of focus panel 30 shows sub-bookmark 
"Die Hard", and area 62b of focus panel 30 shows sub-sub-bookmark "Sub-Bookmark2". 
2 0 [0035] If the user wanted to move upward in the folder hierarchy, the appropriate 

commands (up, down, left, right, and select) are entered and the horizontal and vertical bars 32, 
34 are then appropriately modified. Thus, if the user wanted to ascend to the level, shown in 
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Figure 3, from the point shown in Figure 9, the user would merely enter the "left" command one 
time, as is evident from the fact that in Figure 9 the panel "Film" is shown as being two positions 
away from the focus panel 30. 

[0036] Because the user's current location is always apparent by a display of the folder 

5 path on the horizontal bar 34 irrespective of where in the folder hierarchy the user is currently 
located, navigation by the user up and down and across the folder hierarchy is apparent and 
simple to accomplish without requiring the user to study a lengthy detailed written user's 
manual. 

[0037] To further ease understanding of the hierarchical structure of the folders and sub- 

1 0 folders, etc., shown on the bars 32, 34, each level of folders preferably have a different color or 
coloring scheme. For example, the top level folders are green with black type, while at the next 
level down the bookmarks are blue with black type, and at the next level down the sub- 
bookmarks are red with white type, etc. 

[0038] Although in the above-described embodiment the hierarchical structure of the 

15 user's current location is displayed in the panels on horizontal bar 34, alternatively this 
information may be displayed in the vertical bar 32 so that the information displayed in the bars 
32, 34 are switched completely. Additionally, the names of the folders, bookmarks, etc. may be 
presented at any position on the panels, and instead of text, may be in graphical form and/or may 
also include graphics, as appropriate or desired. 
2 0 [0039] Although the bars 32, 34 are shown as linear, they may be virtual loops so that 

when the user scrolls through the bar to one end, the next panel that is presented is the panel at 
the other end. Thus, if the loop comprises only the folders shown, after scrolling the horizontal 
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bar 34 so that folders pass through the focus panel 30 one after the other until the folder 
originally in panel 49 moves to focus panel 30, the folder in panel 41 will become the folder that 
was originally in panel 51. A virtual loop may also have more entries than are displayed at once. 
Thus, for example, although only six folders are displayed, the virtual loop may actually contain 
5 many more than six folders, with others of the remaining folders being displayed as the user 
scrolls along the bar, thereby causing some of the initial six folders to disappear. 
[0040] Movement of the panels of the bars 32, 34 may be accomplished by entering other 

commands than those discussed above, such as, for example, with reference to the discussion 
above concerning Figures 3 to 9 substituting "left" for "right", "up" for "down", etc. Although it 
10 is preferred for the input device 24 to have four movement command keys so that all four 
possible movement commands can be easily entered, alternatively only two movement command 
buttons may be needed if the bars 32, 34 are virtual loops as discussed. Thus, by pressing a 
horizontal movement command button repeatedly, the appropriate panel will eventually scroll to 
the focus panel 30. 

15 [0041] To allow more of the background picture to be displayed to the user, one or more 

of the panels in one or both of the bars 32, 34 distant from the focus panel 30 may be transparent 
or semi-transparent. In addition, the focus panel 30 itself may also be semi-transparent. 
Although the bars 32, 34 are shown in the figures as being adjacent the left and bottom edges of 
the user interface, they may be positioned adjacent other edges of the user interface. 

2 0 [0042] The focus panel 30 may be displayed in a higher intensity, be shadowed and/or be 

larger than the other panels to enhance the viewability of the focus panel 30. 
[0043] As is apparent, the folders and sub-folders, etc., displayed on the user interface 26 
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are appropriate for the particular electronic device being controlled. For example, if the 
electronic device is a microwave oven, the folders at the top level might include categories of 
heatable food dishes, such as "main dishes", "snacks", "beverages", etc., and lower sub-levels 
for these folders might include other general categories such as "uncooked meal", "reheated 
5 meal", "frozen meal", with sub-sub-folders including particular meals such as "beef stew", 
"lasagna", "pizza", "fish", "French fries", "corn", etc. 

[0044] Thus, while there have been shown and described and pointed out fundamental 

novel features of the present invention as applied to a preferred embodiment thereof, it will be 
understood that various omissions and substitutions and changes in the form and details of the 

10 devices illustrated, and in their operation, may be made by those skilled in the art without 
departing from the spirit of the present invention. For example, it is expressly intended that all 
combinations of those elements and/or method steps which perform substantially the same 
function in substantially the same way to achieve the same results are within the scope of the 
invention. Substitutions of elements from one described embodiment to another are also fully 

15 intended and contemplated. It is also to be understood that the drawings are not necessarily 
drawn to scale but that they are merely conceptual in nature. It is the intention, therefore, to be 
limited only as indicated by the scope of the claims appended hereto. 



20 



